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Abstract 

We study a feedback control version of the flashing Brownian ratchet, 
in which the application of the flashing potential depends on the state 
of the particles to be controlled. Taking the view that the ratchet acts 
as a Maxwell's demon, we study the relationship that exists between the 
performance of the demon as a rectifier of random motion and the amount 
of information gathered by the demon through measurements. In the 
context of a simple measurement model, we derive analytic expressions 
for the flux induced by the feedback ratchet when acting on one particle 
and a few particles, and compare these results with those obtained with its 
open-loop version, which operates without information. Our main finding 
is that the flux in the feedback case has an upper bound proportional to the 
square-root of the information. Our results provide a quantitative analysis 
of the value of information in feedback ratchets, as well as an effective 
description of imperfect or noisy feedback ratchets that are relevant for 
experimental applications. 
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1 Introduction 



Thermal ratchets or Brownian motors can be viewed as controllers that act on 
stochastic systems with the aim of inducing directed motion through the rec- 
tification of fluctuations [T} [21 [31 SI [HI El El - In most cases, the system to be 
controlled is modelled as a collection of Brownian particles undergoing Langevin 
dynamics, and the control action — that is, the rectification mechanism — is im- 
plemented by applying random or deterministic time-dependent perturbations 
to the particles. In this context, one can distinguish, as is common in con- 
trol theory [5], two types of ratchets: (i) open-loop ratchets, which are ratchets 
that apply a rectifying potential independently of the state of the system to be 
controlled; (ii) closed-loop or feedback ratchets, whose rectification action on a 
system has an explicit dependence on that system's evolution in time. 

Examples of open-loop ratchets include the flashing ratchet [2l [3] and the 
rocking ratchet [H [3J . An example of closed-loop ratchet based on the flashing 
ratchet was proposed in [5] (see also [7]). This feedback flashing ratchet could 
be implemented experimentally by monitoring colloidal particles suspended in 
solution and by exposing the particles to a saw-tooth dielectric potential as 
in [9], but with the potential turned on and off depending on particles' state. 
The feedback ratchet of [6] has also been proposed as a mechanism to explain 
the stepping motion of a two-headed motor protein [lOj . In a more general 
context, recent experiments have shown that information about the location of 
a macrocycle in a rotaxane — an organic molecule with a ring threaded onto an 
axle — can be used to induce direct transport away from thermal equilibrium [11] . 
The operation of such a molecular ratchet is information-dependent, as it relies 
on knowledge of the position of the ring. The use of information is also relevant 
in other chemical and biological ratchet-like systems [T2] , 

The main motivation for studying closed-loop ratchets is that they have 
the potential to perform better as rectifiers of motion than open-loop ratch- 
ets, thereby opening the possibility of improving the technological applications 
of ratchets. Our goal in this paper is to establish a quantitative comparison 
between closed- and open-loop ratchets that explicitly focuses on what distin- 
guishes them, namely the use of information. This is done in three steps using 
the feedback ratchet of [6J as a case example. First, we show how the informa- 
tion used by this ratchet can be quantified (Sec. [2]). Then we study how the 
performance of that ratchet, measured by the magnitude of the flux of particles 
that it induces, varies as a function of the amount of information used in the 
ratchet effect (Sec. [3]). The results obtained are discussed in Sec. [Hand com- 
pared with those obtained with the open- loop version of the flashing ratchet, 
which operates without information. In Sec. [H we also discuss the performance 
of the feedback ratchet as a function of the correlation established between 
the controlled system and the controller, and briefly discuss other performance 
measures for feedback ratchets, including the power output and the thermo- 
dynamic efficiency. The results that we obtain are in the end specific to the 
feedback ratchet of [B], but the method that we describe, which is inspired from 
Maxwell's concept of thermodynamic demons (13] ■ information theory [14j and 
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the work of one of us [TS], is general and can be applied to other feedback 
ratchets and other control systems. 



2 Feedback ratchet and information 

The model of feedback ratchet that we study is constructed as follows [5J. We 
consider a system of N particles with positions Xi(t), whose evolution is de- 
scribed by a set of overdamped Langevin equations: 

7±i(i) = a(t)F (xi(t)) + £i(t); i = l,...,N. (1) 

Here, 7 is the friction coefficient related to the diffusion coefficient D through 
Einstein's relation D = ksT '/j, and £,i(t) are Gaussian white noises of zero mean 
satisfying the fluctuation-dissipation relations (&(£)£/(*')) = 2jkBTSij5(t — t'). 
All the particles are subjected to the same potential force F(x) — —V'(x), 
derived from the following asymmetric, saw-tooth potential: 

, x if < f < a 

V(x) = l aL Vl — l — 2 

l^o-^Cf-a) ifa<f <1, 

which is made periodic by the condition V(x + L) = V(x); see Fig.QJa). Finally, 
a(t) is a control parameter that switches the potential on (a = 1) or off (a — 
0). In the open-loop flashing ratchet, the value of a(t) is typically changed 
periodically in time, whereas in the feedback ratchet of [B], a(t) is set to 1 if the 
net force 

1 N 

i=l 

applied to the particles is positive; otherwise, a(t) = 0. Thus a(t) = 8 (f(t)), 
where Q(x) is the Heaviside function. This feedback control strategy is the best 
possible strategy for maximizing the average velocity of one particle, but not the 
best strategy when it comes to more than one particle. This can be understood 
by noting that the system's dynamics tends to get trapped as N — > 00, with 
the consequence that the particle flux decreases to zero in this limit [6j. By 
contrast, the open- loop ratchet induces a flux of particles which is independent 
of the number of particles. 

For the remaining, it is useful to picture the ratchet as a Maxwell's demon 
[13] which rectifies the motion of the Brownian particles by repeatedly estimat- 
ing the sign of fit), and by subjecting the particles to the on or off potential 
depending on the value of the sign measured. When selecting the potential 
at a given time t, the demon uses only the sign of f(t) or, equivalently, a(t) 
at time t. It does not use past information about /(t), nor does it use any 
detailed information about the positions of the particles. Accordingly, what 
should be quantified as the relevant information used by the feedback ratchet is 
the information content or variability of a(t), given by its entropy 

I = H(b) = -61og 2 b - (1 - b) log 2 (l - 6), (4) 
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Figure 1: (a) Ratchet potential, (b) Corresponding effective potential in the 
case of one particle for three values of the noise level p. The potentials are 
plotted for Vb = 5 and a = 1/3. Units: L = 1, D = 1 and fceT = 1. 

where b represents the probability that fit) is negative. The information / 
is measured in bits, and represents the average information content of a{t) in 
that it corresponds to the average number of bits needed to store the random 
outcomes of a{t) [T4] . 

Since our goal is to study the performance of the demon as a function of 
/, we need to supplement our measure of information with a way to vary that 
information. This is accomplished by introducing noise in the estimation of 
f(t). It should be said that noise is always present in control systems in the 
measurement step, in the transmission of the measurement information to the 
controller, or even in the control-actuation step. Moreover, adding noise to a 
ratchet model can provide an effective way of describing an imperfect feedback 
controlled ratchet, such as one plagued by time delays [16]. 

Here we assume that there is a noise in the estimation of f(t), which leads 
the demon to wrongly estimate the sign of f(t) with a probability p S [0, 1/2], 
thereby leading it to apply the wrong potential with probability p. Thus, when 
f(t) > 0, the demon inadvertently switches off the potential with probability p, 
resulting in an effective on potential V c g_ on (x) = (1 — p)V(x). Conversely, when 
f(t) < 0, the demon inadvertently switches on the potential with probability 
p, resulting in an effective off potential V e ff t0 g(x) = pV(x). The combination 
of these two situations leads, in effect, to having the following "noisy" control 
strategy: 

a eS (t) = (l-p)e(f)+pQ(-f). (5) 

From the point of view of information theory, the noisy measurement of 
the sign of f(t) is equivalent to a noisy transmission channel known as the 
binary symmetric channel [14] . The average amount of information transmitted 
through this channel is measured in terms of a quantity known as the mutual 
information (see [2] for a general definition of this quantity). In our case, the 
mutual information can be calculated exactly (see Sec. 8.1.4 of [2]), and has 
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for expression 



I = H(q) - H{p), 



(6) 



where H is, as in Eq. the binary entropy function, p is the noise level, and 
q is the probability that the corrupted sign of f(t) is negative. In terms of the 
probability b that the actual sign of f(t) is negative, we have q = (1 — p)b + 
p(l — b). Note that b depends in general on the number N of particles, the 
characteristics of the ratchet potential V(x), as well as p, so that I is a function 
of all these parameters. 

3 Results 

The noise model that we consider is such that the ratchet operates with maxi- 
mum information when p = 0, in which case / = H (b) < 1, and with minimum 
information (/ = 0) when p = 1/2. To study the exact performance of the 
ratchet in and in between these two regimes, we derive in this section the ex- 
pression of the flux of rectified particles as a function of p, and rewrite this 
expression as a function of / using Eq. ([6]). Both the cases of one particle and 
a few particles are considered. 

3.1 One-particle case 

For a single controlled particle, the net force is simply f(t) = F(x(t)), with 
x{t) the position of the particle. Recalling the form of the saw-tooth potential 
defined in Eq. we have that fit) < for x € (0, aL), and fit) > for 
x G (aL, L). As a result, the effective control parameter a c s(t) can be rewritten 

as 



From this expression, we obtain an exact analytical expression for the average 
flux (x) of the particle by solving the Fokker-Planck equation associated with 
the effective force F e ff(x) = a e ff(a;)F(a;) that derives from the effective control 
potential depicted in Fig. [lib). The result in the stationary regime is 





x = 



F 



?jl-p) 2 V£A 



(8) 



AE - B+B- 



with 



.4 
B ± 



E 



1 _ e (2p-l)V 

e ±pVa [a(l-p)+p(l- a)] - e ±{2p -^ v °pil - a) - o(l - p) 

a 2 i\^pfi\-pV Q -e-^>) 

+ap(l - o)(l - p)(l - e- pVo )[l - e^-P^ } 

+p>(l-a) 2 {l-e( 1 -ri v ° + (l-p)V ], 



(9) 
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Figure 2: (a) Stationary flux as a function of the noise level p for the potential 
heights Vo = 1 and Vo = 5 in the one particle case, (b) Stationary flux as a 
function of the information /. Units: L — 1, D = 1 and fcsT = 1. 



in units where L = 1, D = 1, and fcsT = 1. We have checked that this result is 
correct by performing Langcvin simulations of the feedback ratchet. As seen in 
Fig. Et^a), the flux is maximum for p = and decreases monotonically to zero 
as p goes to 1/2. 

To transform the expression of (x) shown above into a function of /, we 
need to invert the expression of / shown in ([6]) to obtain p as a function of 
/. This requires the expression of 6, which is obtained by integrating over the 
space interval [0, aL] the stationary distribution of the effective Fokker-Planck 
equation, 




Vn(i-v)-\ (i-")p 

I (l-p)a 



e -V (l-2p) _ l 



(10) 



pV 



with (x) given in ((5|), and units L = 1, D = 1, and fc^T = 1. This inversion gives 
the exact result for (i) versus /, which is plotted in Fig.[^b). Unfortunately, we 
cannot provide a closed- form expression of (x)(I) because p(I) seems to have no 
closed-form expression. However, it is possible to derive a useful approximation 
of the exact numerical result reported in Fig. [2f b) . Indeed, we can expand I(p) 
to second order in p around the minimum located at p — 1/2 to obtain 



Jln2 



(1 



(11) 



assuming that b does not depend on p. Then, for small potentials, i.e., Vq <ti 
ksT ', we have b « a and 

(i)«^-(l-2p) (12) 



G 



from Eq. ([5]), so that 

Vr, I 7" In 9 

(13) 




2a(l - a) 



This approximation is a priori valid only in the regime where I < 1 and Vq *C 
fc^T, but Fig. dUb) shows that it is accurate over the whole range of / even 
when Vo ~ kgT . An additional benefit of Eq. (|13p is that it is an upper bound 
on (x) versus / for any value of / and any potential height Vo- This follows 
because the right-hand side of (fT2|) is an upper bound on the exact result shown 
in Eq. © [18]; see Fig.H 

3.2 Few-particle case 

Approximations similar to those given in (|12|) and (|13p can also be derived for 
the case where more than one particle is controlled by the feedback ratchet. In 
the case of a few particles, the net force has a distribution p(f) which can be 
approximated by a Gaussian distribution, 

p(/)«_-L_ e -^ J (14) 



having a zero mean and variance 



S= ; V ° (15) 

Ly/a{l - a)N 

This Gaussian approximation is derived under two basic assumptions [6]: (i) 
the positions of the particles are statistically independent; (ii) the probability 
of finding a particle in a negative force interval (for example [0, aL]) is a. It can 
be shown that these two assumptions are verified for small potential even in the 
presence of noise (i.e., p ^ 0). 

Using the approximation shown in pip , we can obtain an approximate ex- 
pression for the average center-of-mass velocity (x cm ) as a function of the trans- 
mission error p using the relation 



1 

7 J-c 



a eS (f)fp(f)df, (16) 



with a c g(f) given by Eq. ([5]). In our case, we find 



L7^2?ra(l - a)N 



(l-2p). (17) 



We have compared this results with Langevin simulations and found good fits 
for small potentials. For p = 0, the results of [6] for (i cm ) is recovered. In 
addition, we have verified numerically that Eq. (|17p is an upper bound of the 
exact flux for any given potential height. 
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To turn the expression in (| 17[) into an expression involving the information 
/, we use the approximation shown in (jTTJ) again to obtain 



with b the probability of having a negative force in the few particle case. This 
probability can be approximated as 



using the same assumptions as those involved in the Gaussian approximation 
for The resulting approximation for (x cm ) is similar to the approximation 

derived for the one-particle ratchet in that it is a good approximation for small 
values of the potential height, in addition to being an upper bound on the flux for 
any given potential height. The latter property was checked numerically. The 
accuracy of the approximation for the probability b was also checked numerically. 

4 Discussion 

(1) The two approximations shown in (fTS)) and (|18[) express the performance of 
the ratchet demon as a function of the information / that the demon gathers 
through the noisy measurement of a(t). Overall, we see from these results that 
the flux induced by the demon is maximum when it has maximum information, 
i.e., I = H(b), and is zero when it has zero information. This applies both 
for the one-particle and few-particle ratchets. In both cases, we further have 
that the flux decreases monotonically as / decreases, and that the flux is ap- 
proximately proportional to yl. The proportionality constant entering in this 
relation depends on the system's characteristics, and shows, in the case of a 
few particles, an TV dependence that has the effect of reducing the flux as the 
number of particles is increased. This extra reduction of the flux is related to 
the fact that the fluctuations of the force have a smaller amplitude as N grows. 

The decrease of flux directly associated with the decrease of information can 
be explained by noting again that the on and off potentials are partially 'mixed' 
or randomized by the noise. This is particularly evident when p — 1/2, i.e., 
when 1 = 0. In this case, the demon has a completely random estimate of the 
sign of f(t) which is uncorrelated with its true sign; hence 1 = 0. With the 
random value of the sign, the demon then applies a random potential to the 
particles, thereby injecting the noise of the estimation back into the motion of 
the particles. Such a feedback of estimation noise is often encountered in real 
control systems, and can be counteracted in various ways. The most common 
is to rely on past measurements of the controlled system to better estimate 
its actual state (filtering) [8]. For our demon, this would mean acting with 
memory of past measurements of the sign of f(t), and error-correcting those 
measurements to avoid inferring the wrong value of the sign of f(t). 




(18) 




(19) 
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(2) The expressions for the center-of-mass velocity as a function of the noise 
level p or of the information / can be rewritten in terms of the correlation 



C=(sgn/sgn/), (20) 

where sgn/ is the real sign of the net force that the particles would feel if the 
potential were on, while sgn/ is the value that the controller receives. This 
correlation can be computed by using 

C = P+++P— -P+--P-+, (21) 

where Ptj is the joint probability that the real net force / is positive (i = +) 
or negative (i = — ) and that the controller receives a positive (j = +) or 
negative (j = —) net force /. This joint probability is easily computed knowing 

that sgn/ is different from sgn/ with probability p. Thus we have P |_ = bp, 

P__ = 6(1 - p), P+- = (1 - b)p and P ++ = (1 - b)(l - p), where b is the 
probability of sgn/ being negative, so that 

C = \- 2p. (22) 

Using this relation in Eqs. ||5J), (fT2"|) and (fTT|) , we obtain the expressions for the 
center-of-mass velocity as a function of the correlation C. In particular, for 
small potentials, we obtain 

(icm) « C (23) 



for one particle, and 



Vn 

C (24) 



L7^2?ra(l - a)N 
for few particles. 

As for Eqs. (fT2| and (fl7|) . the expressions shown above are upper bounds for 
the center-of-mass velocity for all potential heights, which show that the flux 
performance is reduced when the correlation between the controlled system and 
the controller decreases. This loss of correlation is always present in physical 
systems, and can be due to noise in the measurement of f(t) or in the trans- 
mission of this measurement to the controller. In this sense, the expressions 
shown in (|23p and (f2"4")) can be thought of as describing a noisy feedback ratchet 
for which all the noise sources are effectively described by C. Such an effective 
description in terms of C can be used, in addition, to model other imperfect 
feedbacks, such as time-delayed feedbacks 16 ■ In the latter case, / = fit — r), 
where r is a positive time delay, implying a loss of correlation between the actual 
force / = f(t) and the applied force /. 

Time delays are expected to be present in the experimental implementation 
of the feedback ratchet mentioned in the introduction, in which colloidal parti- 
cles suspended in a solution are monitored and exposed to a saw-tooth dielectric 
potential. The previous discussion can directly be applied to this situation by 
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computing C from the time series of f(t) and the delayed signal f(t — r), al- 
lowing the use of Eqs. (|23|) and ([24]) to predict the effects of time delays on 
the flux. The present noisy feedback model could also be useful as an effective 
description of the operation of an imperfect feedback loop in other ratchet-like 
systems [TU1 ITT] . 

(3) Experimental implementations of feedback ratchets are unavoidably im- 
perfect and noisy due to the aforementioned time delays and other experimental 
imperfections. These real-world limitations can be modelled, to a first level of 
approximation, by an effective noise level p acting at the level of estimation. 
With this in mind, one can use our noisy feedback ratchet model as a valuable 
effective model for estimating the improvement in flux that can be obtained in 
experimental implementations, such as those proposed in [6] [T6l [17] . The au- 
thors of [17], for example, propose a feedback ratchet based on a scanning line 
optical trap. From the relevant parameters of their experimental set-up they 
found a probability of 1% of calculating the wrong sign of f(t), and an infor- 
mation content of about / = 0.9 bits. Using the results presented here, they 
obtain that no more than 95% of the maximum gain achieved by the feedback 
strategy can be observed for that real system. The experimental realization of 
this system is currently under way [T7] . 

(4) In general, the flux generated by the open-loop ratchet is much smaller 
than the flux generated by the feedback ratchet [5] . For the saw-tooth potential 
considered here, the optimal open-loop protocol generating the largest flux is 
the periodic protocol with on-potential time T on and off-potential time T Q g. For 
Vq = bksT and a = 1/3, the optimal values of these times are T on s» 0.06 and 
T ff w 0.05, in units where D = 1 and L — 1, yielding (i C m)opcn ~ 0.3. For the 
one-particle case, we have by comparison (x C m)ciosed « 4.3 when / is maximum. 
For other values of /, the previous results for one and for few particles state that 
the center-of-mass flux (± C m) is upper-bounded by MVT, where M is a constant 
depending on the system's characteristics; this upper-bound is also greater than 
the open-loop value for most values of /. Therefore, we can write 

(^cm)closed (^cm)open 

< mVI. (25) 

The feedback protocol that we have considered, which performs an instan- 
taneous maximization of the center-of-mass velocity [6] , is the optimal protocol 
that maximizes the flux in the one particle case for a noiseless channel (p = 0). 
We expect this protocol to give a flux close to the maximum possible value in 
the few particles case and in the presence of noise with a memoryless protocol 
(note that protocols with memory can perform error correction). Therefore, we 
expect Eqs. (| 1 3[> and (| 18[) to be upper bounds of the maximum flux that can be 
obtained with a memoryless closed-loop control protocol that uses an amount 
of information / about the system. Similarly, the inequality shown in Eq. (|25p 
is expected to set an upper-bound on the maximum improvement that can re- 
sult from changing an open-loop protocol to a memoryless closed-loop protocol. 
This, at least, is the case for one particle, as the instant maximization protocol 
is optimal when applied to one particle. For the few particle case, we expect 
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the inequality to hold, although it could be violated by protocols other than the 
one considered here, as these could potentially be more efficient. 

(5) We have focused here on proving an upper bound for the particle flux 
because this quantity can readily be measured in experimental realizations of 
feedback ratchets [T7] . In a recent paper [TI5] , written after the present one, an 
analogous upper bound was derived for the power output of a feedback ratchet, 
based on the results and techniques presented here. The difference between the 
particle flux and the power output is that the latter quantity requires that we 
impose a constant load force against the flux so as to compute the work done 
against the load; see [TO] for more details. 

(6) Another important performance measure for ratchets is the efficiency [20 . 
For the computation of this quantity, it is important to note that feedback ratch- 
ets have an extra energy input compared to open-loop ratchets, related to the 
fact that information has an energy cost [13] . This energy cost, known as Lan- 
dauer's erasure cost because it is incurred when information is erased, effectively 
prevents Maxwell's demon-type engines, like feedback ratchets, to have efficien- 
cies greater than one (as required by the second law of thermodynamics) [13] . 
The calculation of this energy cost requires the computation of the mutual in- 
formation between the controlled system and the controller, conditioned on the 
past history of the controller's evolution [T5][3T]. The role of the conditioning is 
to take into account the correlations between the measurements, and to avoid 
redundancies in the computation of the entropy reduction. The conditioning is 
also consistent with the fact that the controller's measurement record, seen as 
blocks of bits, must be compressed before it is erased in order to minimize the 
erasure cost; see Ref. [22] . 

(7) We have not addressed the many particle case, i.e., the case where the 
fluctuations in the net force are smaller than the typical values of the net force. 
The reason for this omission is that, in the many particle case, the maximum in- 
crease of performance that results from changing the optimal open-loop protocol 
to a closed-loop protocol is negligible. 

5 Summary 

In summary, we have quantified the information gathered by a feedback control 
ratchet, and have derived analytical upper bounds, expressed as a function of 
the information, which establish limits on the difference between the flux of 
particles created by a closed-loop, flashing ratchet and the flux created by its 
open-loop version. These bounds provide a direct evaluation of the performance 
of the feedback ratchet as a function of the information that it uses, and make 
more precise the idea that feedback ratchets act like Maxwell's demons that 
use information about the state of particles to rectify the particles' motion. In 
addition, the analytic results found for the flux are useful in that they provide 
an effective description of a feedback flashing ratchet affected either by noise 
in the measurement process or other imperfections in the feedback mechanism. 
This effective description is useful for predicting the results of experimental 
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realizations of feedback ratchets, as any experimental realization is subjected to 
noises, delays, and other imperfections in the feedback. 
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